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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

1. (currently amended) A method of improving color image data, comprising the steps of: 

a) placing over a unit area a predetermined spatial pattern of color-component 
specific photo elements in a sensor, each of the color-component specific photo 
elements filtering a single predetermined color-component over one of sub-unit 
areas in the unit area, each of the color-component specific photo elements 
corresponding to a single pixel; 

b) sampling color image data at the sensor; 

c) generating chroma values for each of the color-component specific elements 
from the color image data; 

d) simul taneously adjusting the chroma values with said step (c according to the 
specific spatial pattern of the color-component specific elements based upon 
coefficients that spatially correspond to a specific set of the color-component 
specific photo elements; and 

e) estimating an intensity value for each of the pixels based upon the chroma 
values adjusted in said step d) and the color image data from said step b). 

2. (original) The method of improving resolution in color image data according to claim 1 
further comprising the steps of: 

f) further adjusting the chroma values for an improved color characteristic 
between said step d) and said step e). 

g) adjusting the intensity value for an improved edge characteristic after said 
step e); and 

h) generating RGB data based upon the chroma values adjusted in said step f) 
and the intensity value adjusted in said step g). 
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3. (original) The method of improving color image data according to claim 2 further 
comprising an additional step i) of gamma converting the RGB data after said step h). 

4. (original) The method of improving color image data according to claim 1 wherein 
the color image data is in a RGB data format in said step a). 

5. (previously presented) The method of improving color image data according to claim 
1 wherein said step a) uses a first predetermined matrix for converting the color image 
data to the RGB data format. 

6. (original) The method of improving color image data according to claim 5 further 
comprising an additional step j) of gamma converting the RGB data. 

7. (original) The method of improving color image data according to claim 5 wherein 
said step d) uses a second predetermined matrix for converting the RGB data to the 
chroma values. 

8. (original) The method of improving color image data according to claim 7 wherein 
said first matrix and said second matrix are combined into a third matrix to be applicable 
in an additional step for replacing said step a), said step b) and said step c). 

9. (original) The method of improving color image data according to claim 1 wherein 
said step d) adjust the chroma values based upon a predetermined filter. 

10. (original) The method of improving color image data according to claim 7 wherein 
the intensity in said step e) has a range equal to all of the color-component specific photo 
elements in the sensor. 
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1 1 . (previously presented) The method of improving color image data according to 
claim 10 wherein the intensity in said step e) is determined based upon following 
equations: 



Y =YoCCDl+YiCr+Y 2 Cb 

Y 0 = -C G /C 

Yi = (Rl C G -Gl C r )/C 

Y 2 = (B1 C G -G1 Cr)/C 

C = -Gl + Gl C R - Rl C G - Bl C G + Gl C B 
where Y is intensity of one of the color-component specific elements; CCD1 is a color 
image data value from a predetermined photo sensor element; C r and Cb are the chroma 
values; Rl, Gl and Bl are a portion of the first matrix; C R , Cb and Ccare predetermined 
constants. 



12. (currently amended) A system for improving color image data, comprising: 

a color image sensor having multiple sets of a predetermined spatial pattern of 
color-component specific photo elements for generating color image data, each of the 
color-component specific photo elements filtering a predetermined color-component over 
one of sub-unit areas in a unit area, said color image sensor sampling the color image 
data for the unit area using the color-component specific photo elements, each of the 
color-component specific photo elements corresponding to a single pixel; 

an interpolated chroma value generator connected to said color image sensor for 
generating interpolated chroma values according to the spatial pattern and for 
simultaneously adjusting the chroma values based upon coefficients that spatially 
correspond to a specific set of the color-component specific photo elements; and 

an intensity estimator connected to said interpolated chroma value generator and 
said color image sensor for estimating an intensity value for each of the pixels based 
upon the interpolated chroma values and the color image data. 
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13. (original) The system for improving color image data according to claim 12 
wherein said interpolated chroma value generator further comprises a color-component 
specific spatial filter for interpolating the color image data and a convertor for converting 
the color image to the chroma values. 

14. (original) The system for improving color image data according to claim 12 further 
comprising a smoothing filter connected between said interpolated chroma value 
generator and said intensity estimator for reducing an error amount in the color image 
data. 

15. (original) The system for improving color image data according to claim 14 further 
comprising an edge enhancement filter connected to said intensity estimator for 
enhancing an edge. 

16. (original) The system for improving color image data according to claim 15 further 
comprising a RGB converter connected to said smoothing filter and said edge 
enhancement filter for generating a set of RGB data. 

17. (previously presented) The system for improving color image data according to 
claim 12 wherein said color image sensor is one dimensional. 

18. (previously presented) The system for improving color image data according to 
claim 12 wherein said color image sensor is two-dimensional. 

19. (previously presented) The system for improving color image data according to 
claim 1 8 wherein said color image sensor is at least three by three of said color- 
component specific photo elements. 
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20. (original) The system for improving color image data according to claim 14 
wherein said smoothing filter is a median filter for outputting a median value. 

21 . (original) The system for improving color image data according to claim 14 
wherein said smoothing filter is a low-pass filter for outputting a median value. 

22. (original) The system for improving color image data according to claim 12 
wherein said intensity estimator estimates the intensity value in a range equal to all of the 
color-component specific photo elements in said single-plane color image sensor. 

23. (previously presented) The system for improving color image data according to 
claim 22 wherein said intensity estimator estimates the intensity value based upon 
following equations: 

Y =Y 0 CCDl+YiC r + Y 2 Cb 

Y 0 = -C G /C 

Yi = (Rl C G -Gl Cr)/C 

Y 2 = (BICg-GI Cr)/C 

C = -G1+G1 Cr-R1 Cg-B1 Cg + G1 C b 
where Y is intensity of one of the color-component specific elements; CCD1 is a color 
image data value from a predetermined photo sensor element; C r and Cb are the chroma 
values; Rl, Gl and Bl are a portion of the first matrix; C R? C B and Cg are predetermined 
constants. 

24. (original) The system for improving resolution in color image data according to 
claim 12 further comprising a parameter storage for storing multiple sets of parameters 
and a control unit connected to said parameter storage and said intensity estimator for 
selecting one of the sets of the parameters based upon a particular location in the spatial 
pattern. 
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25. (currently amended) A program storage device readable by a machine, tangibly 
embodying a program of instructions executable by the machine to perform method steps 
of reproducing a high-resolution image, said method steps comprising: 

k) placing over a unit area a predetermined spatial pattern of color-component 
specific filter elements on a single plane in a sensor, each of the color-component 
specific filter elements filtering a predetermined color-component over one of 
sub- unit areas in the unit area, each of the color-component specific filter 
elements corresponding to a single pixel; 

1) sampling color image data for the unit area using the color-component specific 
filter elements, a portion of the color image data being sampled only through a 
corresponding one of the color-component specific filter elements for a 
corresponding one of the sub-unit areas; 

m) generating chroma values for each of the color-component specific elements 
from the color image data; 

n) si mu ltaneo usly adjusting the chroma values with said step m) according to the 
specific spatial pattern of the color-component specific elements based upon 
coefficients that spatially correspond to a specific set of the color-component 
specific filter elements; 

o) fethef simu ltaneou sly adj usting the chroma values for smoothing the chroma 
values adjwted-in said step In); 

p) estimating an intensity value for each of the pixels based upon the chroma 
values twice adjusted in said steps n) and o) and the color image data from said 
step 1); 

q) adjusting the intensity value for each of the pixels for an improved edge 
characteristic after said step p); and 

r) generating RGB data based upon the chroma values adjusted in said step n) and 
the intensity value adjusted in said step q). 



DOCKET NO.: RCOH-0096DIV PATENT 

Application No.: 10/630,824 

Response to Office Action dated July 9, 2008 

Amendment dated September 23, 2008 

Page 8 of 17 

26. (currently amended) A program storage device readable by a machine, tangibly 
embodying a program of instructions executable by the machine to perform method steps 
of reproducing a high-resolution image, said method steps comprising: 

j) generating color image data from at a sensor having a specific unit spatial 
pattern of color-component specific photo elements, each of the color-component 
specific photo elements corresponding to a single pixel; 
k) generating chroma values for each of the color-component specific elements 
from the color image data; 

1) simultaneously adjusting the chroma values wi th sa id step k) according to the 
specific unit spatial pattern of the color-component specific elements based upon 
coefficients that spatially correspond to a specific set of the color-component 
specific photo elements; 

m) further adjusting the chroma values for smoothing the chroma values adjusted 
in said step 1); 

n) estimating an intensity value based upon the chroma values twice adjusted in 
said steps 1) and m) and the color image data from said step j); 
o) adjusting the intensity value for an improved edge characteristic after said step 
n); and 

p) generating RGB data based upon the chroma values adjusted in said step m) 
and the intensity value adjusted in said step o). 

27. (currently amended) A method of improving color image data, comprising the steps 
of: 

a) placing over each of unit areas a predetermined spatial pattern of color- 
component specific filter elements in a sensor, each of the color-component specific filter 
elements filtering a single predetermined color-component over one of sub-unit areas in 
the unit area, each sub-unit area corresponding to a single pixel; 

b) sampling color image data for the unit areas using the sensor; 
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c) generating chroma values for each of the color-component specific elements 
from the color image data; 

d) simultaneguslv adjusting the chroma values with said step c] according to the 
specific spatial pattern of the color-component specific elements based upon coefficients 
that spatially correspond to a specific set of the color-component specific filter elements; 
and 

e) estimating an intensity value based upon the chroma values adjusted in said 
step d) and the color image data from said step b) for each of the pixel 

28. (previously presented) The method of improving color image data according to 
claim 27 further comprising the additional steps of: 

f) further adjusting the chroma values for an improved color characteristic 
between said step d) and said step e). 

g) adjusting the intensity value for an improved edge characteristic after said step 

e); and 

h) generating RGB data based upon the chroma values adjusted in said step f) and 
the intensity value adjusted in said step g). 

29. (previously presented) The method of improving color image data according to 
claim 28 further comprising an additional step i) of gamma converting the RGB data after 
said step h). 

30. (previously presented) The method of improving color image data according to 
claim 27 wherein the color image data is in a RGB data format in said step a). 

3 1 . (previously presented) The method of improving color image data according to 
claim 30 wherein said step a) uses a first predetermined matrix for converting the color 
image data to the RGB data format. 
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32. (previously presented) The method of improving color image data according to 
claim 31 further comprising an additional step j) of gamma converting the RGB data. 

33. (previously presented) The method of improving color image data according to 
claim 3 1 wherein said step d) uses a second predetermined matrix for converting the 
RGB data to the chroma values. 

34. (previously presented) The method of improving color image data according to 
claim 33 wherein said first matrix and said second matrix are combined into a third 
matrix to be applicable in an additional step for replacing said step a), said step b) and 
said step c). 

35. (previously presented) The method of improving color image data according to 
claim 27 wherein said step d) adjust the chroma values based upon a predetermined filter. 

36. (previously presented) The method of improving color image data according to 
claim 33 wherein the intensity in said step e) has a range equal to all of the color- 
component specific photo elements in the sensor. 

37. (previously presented) The method of improving color image data according to 
claim 36 wherein the intensity in said step e) is determined based upon following 
equations: 

Y =YoCCDl+YiC r + Y 2 C b 

Y 0 = -C G /C 

Yi = (Rl C G -Gl Cr)/C 

Y 2 = (B1 Cg-G1 Cr)/C 

C = -Gl + Gl C R - Rl C G - Bl C G + Gl C B 
where Y is intensity of one of the color-component specific elements; CCD1 is a color 
image data value from a predetermined photo sensor element; C r and Cb are the chroma 
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values; Rl, Gl and Bl are a portion of the first matrix; Cr 5 C b and Ceare predetermined 
constants. 



38. (currently presented) A system for improving color image data, comprising: 

a color image sensor having a predetermined spatial pattern of color-component 
specific photo elements for generating color image data, each of the color-component 
specific photo elements filtering a single predetermined color-component over one of 
sub-unit areas in a unit area corresponding to a single pixel, said color image sensor 
sampling the color image data; 

an interpolated chroma value generator connected to said color image sensor for 
generating interpolated chroma values for each of the pixels according to the spatial 
pattern and for simultaneously adjusting the chroma values based upon coefficients that 
spatially correspond to a specific set of the color-component specific photo elements; and 
an intensity estimator connected to said interpolated chroma value generator and 
said color image sensor for estimating an intensity value for each of the pixel based upon 
the interpolated chroma values and the color image data. 



39. (previously presented) The system for improving color image data according to 
claim 38 wherein said interpolated chroma value generator further comprises a color- 
component specific spatial filter for interpolating the color image data and a converter for 
converting the color image to the chroma values. 

40. (previously presented) The system for improving color image data according to 
claim 38 further comprising a smoothing filter connected between said interpolated 
chroma value generator and said intensity estimator for reducing an error amount in the 
color image data. 
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41 . (previously presented) The system for improving color image data according to 
claim 40 further comprising an edge enhancement filter connected to said intensity 
estimator for enhancing an edge. 

42. (previously presented) The system for improving color image data according to 
claim 41 further comprising a RGB converter connected to said smoothing filter and said 
edge enhancement filter for generating a set of RGB data. 

43. (previously presented) The system for improving color image data according to 
claim 38 wherein said color image sensor is one dimensional. 

44. (previously presented) The system for improving color image data according to 
claim 38 wherein said color image sensor is two-dimensional. 

45. (previously presented) The system for improving color image data according to 
claim 44 wherein said color image sensor is at least three by three of said color- 
component specific photo elements. 

46. (previously presented) The system for improving color image data according to 
claim 40 wherein said smoothing filter is a median filter for outputting a median value. 

47. (previously presented) The system for improving color image data according to 
claim 40 wherein said smoothing filter is a low-pass filter for outputting a median value. 

48. (previously presented) The system for improving color image data according to 
claim 38 wherein said intensity estimator estimates the intensity value in a range equal to 
all of the color-component specific photo elements in said color image sensor. 
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49. (previously presented) The system for improving color image data according to 
claim 48 wherein said intensity estimator estimates the intensity value based upon 
following equations: 

Y =YoCCDl+YiC r + Y 2 C b 

Y 0 = -C G /C 

Yi = (Rl C G -Gl Cr)/C 

Y 2 = (B1 Cg-G1 Cr)/C 

C = -Gl + Gl C R - Rl C G - Bl C G + Gl C B 
where Y is intensity of one of the color-component specific elements; CCD1 is a color 
image data value from a predetermined photo sensor element; C r and Cb are the chroma 
values; Rl, Gl and Bl are a portion of the first matrix; C R , C B and Co are predetermined 
constants. 

50. (previously presented) The system for improving resolution in color image data 
according to claim 38 further comprising a parameter storage for storing multiple sets of 
parameters and a control unit connected to said parameter storage and said intensity 
estimator for selecting one of the sets of the parameters based upon a particular location 
in the spatial pattern. 

51. (currently amended) A program storage device readable by a machine, tangibly 
embodying a program of instructions executable by the machine to perform method steps 
of reproducing a high-resolution image, said method steps comprising: 

k) placing over each of unit areas a predetermined spatial pattern of color- 
component specific filter elements in a sensor, each of the color-component specific filter 
elements filtering a single predetermined color-component over one of sub-unit areas in 
the unit area, each sub-unit area corresponding to a single pixel; 

1) sampling color image data for the unit area using the color-component specific 
filter elements; 
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m) generating chroma values for each of the color-component specific elements 
from the color image data; 

n) §llIiyl!iJi?51l?lx ...adjusting the chroma values said steg m) according to the 
predetermined spatial pattern of the color-component specific elements based upon 
coefficients that spatially correspond to a specific set of the color-component specific 
filter elements; 

o) further adjusting the chroma values for smoothing the chroma values adjusted 
in said step n); 

p) estimating an intensity value for each of the pixels based upon the chroma 
values twice adjusted in said steps n) and o) and the color image data from said step 1); 

q) adjusting the intensity value for an improved edge characteristic after said step 

p); and 

r) generating RGB data based upon the chroma values adjusted in said step o) and 
the intensity value adjusted in said step q). 



